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Preface 


Expert systems is probably the "hottest" topic in Artificial 
Intelligence (AI) today. In the past, in trying to find 
solutions to problems, AI researchers tended to rely on search 
techniques or computational logic. These techniques were 
successfully used to solve elementary or toy problems or very 
well structured problems such as games. However, real complex 
problems are prone to have the characteristic that their search 
space tends to expand exponentially with the number of 
parameters involved.. For such problems, these older techniques 
have generally proved to be inadequate and a new approach was 
needed. This new approach emphasized knowledge rather than 
search and has led to the field of Knowledge Engineering and 
Expert Systems. 

This report provides a current overview of Expert Systems — 
what it is, techniques used, existing systems, applications, who 
is doing it, who is funding it, the state-of-the-art, research 
requirements and future trends and opportunities. 

This report is in support of the more general NBS/NASA 
report, "An Overview of Artificial Intelligence and Robotics." 
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pRSGs^ii' P'ms: 

X , Introduction OF POOR QU^LSiiii {!' 

In the 70'Sf it became apparent to the AI community, that 
••arch strategies alone, even augmented by heuristic* evaluation 
functions, were often inadequate to solve real world problems. 
Th« complexity of these problems were usually such that (without 
incorporating substantially more problem knowledge than had here- 
tofore been brought to bear) either a combinatorial explosion 
.occurred that defied r.easonable search times, or that the ability 
to generate a suitable search space did not exist. In fact, it 
became apparent that for. many problems; that expert^ domain 
knowledge was even more important than the search strategy (or 
inference procedure). This realization led to the field of 
"Knowledge Engineering," which focuses on ways to bring expert 
knowledge to bear in problem solving.** The resultant expert 
systems technology, limited to academic laboratories in the 70's, 
is now becoming cost-effective and is beginning to enter into 
commercial applications. 


*Be uristics are "rules of thumb," knowledge or other techniques 
that can be used to help guide search. 

**One important aspect of the knowledged-based approach is that 
the combinatorial complexity associated with real-world problems 
is mitigated by the more powerful focussing of the search that 
csn be obtained with rule-based heuristics usually used in expert 
systems as opposed to the numerical heuristics (evaluation 
functions) used in classical search techniques. In other words, 
the rule-based system is able to reason about its own search 
effort, in addition to reasoning about the problem domain. (Of 
course, this also implies that the search strategy is incomplete. 
Solutions may be missed, and an entire search may fail even when 
there is a solution "within reach" in the problem space defined 
»>y the domain.) 


1 



[-"VAtei 
O ’ i '• ^ 


OF POOR 


I I . What is an Expert System? 

Feigenbaum, a pioneer in expert systems^ (1982, p. 1) states: 

An "expert system" is an intelligent computer pro'g^'hm 
that uses knowledge and inference procedures to solve 
problems that are difficult enough to require significant 
human expertise for their solution. The knowledge necessary 
to perform at such a level, plus the inference procedure‘s 
used, can be thought of as a model of the expertise of the 
best practitioners of the field. 


The knowledge of an expert system consists of fact's 
and heuristics. The "facts" constitute a body of 
information that is widely shared,, publicly ava ilable-/- and 
generally agreed upon by experts in a field. The 
"heuristics" are mostly private, little-discussed rules o?f 
good judgment (rules of plausible reasoning, rules of good 
guessing) that ' character ize expert-level decision making in 
the. field... The pe-r for mance- level of an expert system is 
primarily a function of the size and quality oftHe 
knowledge base that it possesses. 

^ V ~ i 

Basic Structure of an Expert System 

■ ■ ■■ •■■ 1 " 

An expert system consists of: ' 


1) a knowledge base (or knowledge source) of domain facts 
and heuristics associated with the problem; 

. ( 

2) an inference procedure (or control structure) for 

. 

utilizing the knowledge base in the solution of the 
problem; 

3) a working memory - "global data base” - for keepi^fg 
track of the problem status, the input data for the 
particular problem, and the relevant history of what 
has thus far been done. 

A human "domain expert" usually collaborates to help develop 
the knowledge base. Once the system has been developed, in 
addition to solving problems, it can also be used to heBp 
instruct others in developing their own expertise. 

Thus, Michie (1980, pp. 3-5) observes: 
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•..that there are three different user-modes for an expert 
system in contrast to the single mode (getting answers to 
problems) characteristic of the more familiar type of 
computing : 

(1) getting answers to problems — user as client; 

(2) improving or Increasing the system's knowledge — user 
as tutor; 

(3) harvesting the knowledge base for human use — user as 
pupil . 

Users of an expert system in mode (2) are known as "domain 
specialists." It.i.s not possi.ble to. build an expert system 
withoutone... 

An expert systems acts as a systematizing repository over 
time of the knowledge accumulated by many specialists' of 
• diverse experience. Hence, it can and does, ultim^ately 
attain a level of consultant expertise exceeding* that of 
any single one of its "tutors." 

It is usual to have a natural language interface to 
facilitate the use of the system in all three modes. Normally, 
an explanation module is also included, allowing the user to 
challenge and examine the reasoning process underlying the 
system's answers. Figure 1 diagrams a typical (though somewhat 
idealized) expert system. When the domain knowledge is stored as 
production rules, the knowledge base is often referred to as the 
"rule base," and the inference engine the "rule interpreter." 

An expert system differs from more convential computer 
programs in several important respects. Duda (1981, p. 242) 
observes that, in an expert system, "...there is a clear 
separation of general knowledge about the problem (the rules 


♦There are not yet many examples of expert systems whose 
performance consistently surpasses that of an expert. And 
currently, there are even fewer examples of expert systems that 
use knowledge from a group of experts and integrate it 
effectively. However the promise is there. 
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BASIC STRUCTURE OF AN EXPERT SYSTEM 





forming a knowledge base) from information about the current 
problem (the Input data) and methods for applying the general 
knowledge to the problem (the rule interpreter)." In a 
conventional computer program, knowledge pertinent to the problem 
and methods for utilizing this knowledge are all intermixed, so 
that it is difficult to change the program. In an expert system, 
"...the program itself is only an interpreter (or general 
reasoning mechanism) and [ideally], the . system can .be . chang.ed by 
simply adding or substracting rules in the knowledge base." 



IV. The Knowledge Base 


The most popular approach to representing the domain 
knowledge needed for an expert system is by production rules 
(also referred to as "SITUATION-ACTION rules" or "IF-THEN 
rules"). ThuSf often acknowledge base is made up mostly of rules 
which are invoked by pattern matching with features of the task 
environment as they currently appear in the global data base. 

The rules in a knpwledge base represent the domain fa.cta .and 
heuristics - rules of good judgment of actions to take when 
specific situations 'arise. The power of the expert system’ lies 
in the specific knowledge of the problem domain, with potentially 
the most powerful systems being the ones containing the most 
knowledge. 

Duda (1981, p. 242) states: 

Most existing rule-based systems contain 
hundreds of rules, usually obtained by interviewing 
experts for weeks or months... In any system, the 
rules become connected to each other by association 
linkages to form rule networks. Once assembled, such 
network's can represent a substantial body of 
knowledge .... 

An expert usually has many judgmental or empirical rules, 
for which there is incomplete support from the available 
evidence. In such cases, one approach is to attach numerical 
values (certainty factors) to each rule to indicate the degree of 
certainty associated with that rule. (In expert system 
operation, these certainty values are combined with each other 
and the certainty of the problem data, to arrive at a certainty 
value for the final solution.) 

Michie (1980, p. 6) indicates that the cognitive strategies 
of human experts in more complex domains are based "...not on 
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elaborate calculations > but on the mental storage and use o£ 
large Incremental catalogs of pattern-based rules." Thus, human 
chess masters may be able to acquire, organize and utilize as 
much as 50,000 pattern-based rules in achieving their remarkable 
performance. Michie (p. 20-21) indicates that such rules are so 
powerful that only some 30 rules are needed for expert system 
performance for a chess subdomain such as King and Knight against 
King and Rook, which has a problem space size of roughly 
2,000,000 configurations. He further observed for chess that the 
number, of. rules required .grows slowly relative to .the .Increase in. 
domain complexity. Thus, in chess and other complex domains 
(such as industrial routing and scheduling) it appears that well- 
chosen pattern sets may maintain control over otherwise 
intractable explosions of combinatorial complexity. 
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V. The Inference Engine 

The problem-solving paradigm, and its methods, 
organizes and controls the steps taken to solve the 
problem. One commonplace but powerful paradigm 
involves the chaining of IF-THEN rules to form a line 
of reasoning. If the chaining starts from a set of 
conditions and moves toward some (possibly remote) 
conclusion, the method is called forward chaining . If 
the conclusion is known (e.g., it is a goal to be 
achieved), but the path to that conclusion is not 
known, then working backwards is called for, and the 
method is back w ard chaining . (Heuristic Programming 
Project, 1980, p. 6) 

problem' with forward chaining, without appropriate 
heuristics for pruning, is that you would derive everything 
possible whether, you. needed it. or not.. Backward , chaining works 
from goals to subgoals (by using the action side of rules to 
deduce the condition side of the rules). The problem here, again 
without appropriate heuristics for guidance, is the handling of 
conjunctive subgoals. In general to attack a conjunction, one 
must find a case where all Interacting subgoals are satisfied, a 
search for which can often result in a combinatorial explosion of 
possibilities. Thus appropriate domain heuristics and suitable 
inference schemes and architectures must be found for each type 
of problem to achieve an efficient and effective expert system. 

The knowledge of a task domain guides the problem- 
solving steps taken. Sometimes the knowledge is quite 
abstract — for example, a symbolic model of "how things 
work” in the domain. Inference that proceeds from the 
model's abstractions to more detailed (less abstract) 
statements is called m odel-driven inference. Always 
when one is moving from more abstract symbolic 
statements to less abstract statements, one is 
generating expectations, and the problem-solving 
behavior is termed expectation driven . Often in 
problem solving, however, one is working "upwards" from 
the details or the specific problem data to the higher 
levels of abstraction (i.e., in the direction of “what 
it all means"). Steps in this direction are call data 
dr iven . If you choose your next step either on the 
basis of some new data or on the basis of the last 
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problem-solving step taken# you are responding to 
events# and the activity is called event d£^ v e n . 
(Heuristic Programming Project 1980# p. 6). 

As indicated earlier# an expert system consists of three 
major components# a set of rules# a global data base and a rule 
interpreter. The rules are actuated by patterns# (which match 
the IF sides of the rules) in the global data base. The 
application of the rule changes the system status and therefore 
the data ■-bas-.e# enabling some rules and- disabling...other s.. The 
rule interpreter uses a control strategy for finding the enabled 
rules and deciding which rule to apply. The basic control 
strategies used may be top down (goal driven)# bottomup (data 
driven)# or a combination of the two that uses a relaxation-like 
convergence process to join these opposite lines of reasoning 
together at some intermediate point to yield a problem solution. 
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VI . Uses of Expert Systems 

The uses of expert systems are virtually limitless. They 
can be used to: 

* diagnose 

* monitor 

* analyze 

* interpret 

* consul.t ^ .. . . . • ■ ‘ - 

* plan 
■•design 

* ■ instruct 

* explain 

* learn 

* conceptualize 

Thus they are applicable to: 

* Mission planning, monitoring, tracking and control 

* Communication 

* Signal analysis 

* Command and control 

* Intelligence analysis 

* Targeting 

* Construction and manufacturing 

- design, planning, scheduling, control 

* Education 

- instruction, testing, diagnosis 

* Equipment 

- design, monitoring, diagnosis, maintenance, repair, 
operation, instruction 
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Image Analysis and Interpretation 
Professions (law» medic ine> engineering r accounting, 
law enforcement) 

•* Consulting, instruction, interpretation, analysis 
Software 

- Specification, design, verification, maintenance, 
instruction 

^Wf^appn Systems. 

- Target identification, electronic warfare, adaptive 

'Control.- ■ 
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VII. Architecture of Expert Systems 
A . Introduction 

One way to classify expert systems is by function (e.g. 
diagnosis# planning, etc). However, examination of existing 
expert systems indicate that there is little commonality in 
detailed system architecture that can be detected from this 
classification. 

...A, more fr u i t ful approach appear s- to' be to look 'at problem 
complexity and problem structure and deduce what data and control 
structures might be appropriate to handle these factors. 

The Knowledge Engineering community has evolved a number of 
techniques which can be utilized in devising suitable expert 
system architectures. These techniques* are described in the 
following portions of this section. 

The use of these techniques in existing expert systems is 
illustrated in Table 1**. Table 1 describes the basic approach 
taken by each of these expert systems and indicates how the 
approach translates into key elements of the Knowledge Base, 
Global Data Base and Control Structure. A listing of the systems 
in Table 1, together with an indication of their basic control 
structures, is given in Table 2. 

Table 2 represents the expert system control structures in 
terms of the search direction, the control techniques utilized 
and the search space transformations employed. The approaches 


*This chapter is largely derived from information contained in 
the excellent tutorial by Stefik et al. (1982). 

**Tables 1-1 to 1-4 are shown on the following pages. Table 1-5 
to 1-17 are at the back of this report. 
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SYSTEM: MYCIN • i-4 . 

INSTITUTION: Stanford University ' C 

' ~~ Characteristics of Example Expert Systems 

AUTHORS: Shortliffe ^ ^ ^ 

FUNCTION: Diagnosis - 





Table 2 ( Control Structure 
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used in the various expert systems are different implementations 
of two basic ideas for overcoming the combinatorial explosion 
associated with search in real complex problems. These two ideas 
ar e : 

(1) Find ways to efficiently search a space, 

(2) Find ways to transform a large search space into 
smaller manageable chunks that can be searched 
efficiently. 

It^. will be. observed from. Table 2 that the r e •. is 1 i ft le ' 
architectural commonality based either on function or domain of 
expertise. Ihstead, expert system design may best be considered 
as an art form, like custom home architecture, in which the 
chosen design can be implemented using the collection of 
techniques discussed below. 

B . Choice of Solution Direction 

1 . Forward Chaining 

When data or basic ideas are a starting point, forward 
chaining is a natural direction for problem solving. It has 
been used in expert systems for data analysis, design, 
diagnosis, and concept formation. 

2 . Background Chaining 

This approach is applicable when a goal or a 
hypotheses is a starting point. Expert system examples 
include those used for diagnosis and planning. 

3 . Forward and Backward Processing Combined 

When the search space is large, one approach is to 
search both from the initial state and from the goal or 
hypothesis state and utilize a relaxation type approach to 
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match the solutions at an Intermediate point. This approach 
is also useful when the search s pa ce can be divided 
hierarchically, so both a bottom up and top down search can 
be appropriately combined. Such a combined search is 
particularly applicable to complex problems incorporating 
uncertainties, such as speech understanding as exemplified 
in HEARSAY II. 

4 . Event Driven 

This problem solving direction is similar to forward 
chaining except that the data or situation is evolving over 
• time. In this case the next step is chosen either on the . 
basis of new data or in response to a changed situation 
resulting from the last problem solving step taken. This 
event driven approach is appropriate for real-time 
operations, such as monitoring or control, and is also 
applicable to many planning problems. 

C . Reasoning in the Presence of ; Uncertainty 

In many cases, we must deal! with uncertainty in data or in 

« 

knowledge. Diagnosis and data analysis are typical examples. 

1. Numeric Procedures 

Numeric procedures have been devised to hand l*e 
approximations by combining evidence. MYCIN utilizes 
"certainty factors" (related to probabilities) which use the 
range of 0 to 1 to indicate the strength of the evidence. 
Fuzzy set theory, based on possibilities, can also be 
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utilized 



2 . Belief Revision or "Truth Maintenance" 

Often, beliefs are formed or lines of reasoning are 
developed based on partial or errorful information. When 
contradictions occur, the incorrect beliefs or lines of 
reasoning causing the contradictions, and all wrong 
conclusions resulting from them, must be retracted. To 
enable this, a data-base record of beliefs and their 
justifications must be maintained. Using this approach, 

’truth ■ maintenance techh iques'ban exploit redundancies in 

experimental data to increase system reliability. 

D . Searching a Small Search Space .. . 

Many straightforward problems in areas such as design, 
diagnosis and analysis have small search spaces, either because 
1) the problem is small or 2), the problem can be broken up into 
small independent subproblems. Often ai single line of reasoning 
is sufficient and so backtracking is not required. In such 
cases, the direct approach of exhaustive search can be 
appropriate, as was used in MYCZN and Rl. 

E . Techniques for Searching a Large Search Space 
1. Hierarchical Generate and Test 

State space search is often formulated as "generate and 

(*. 

u 

test" - reasoning by elimination. In this approach, the 
system generates possible solutions and a tester prunes 
those solutions that fail to meet appropriate criteria. 
Such exhaustive reasoning by elimination can be appropriate 
for small search spaces, but for large search spaces more 
powerful technique are needed. A "hierarchical generate and 
test" approach can be very effective if means are available 
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for evaluating candidate solutions that are only partially 
specified. In these cases, early pruning of whole branches 
(representing entire classes of solutions associated with 
these partial specifications) Is possible, massively 
reducing the search required. 

"Hierarchical generate and test" Is appropriate for 
many large data Interpretation and diagnosis problems, for 
which . all., solutions . are desired, providing a generator can 
be devised that can partition the solution space in ways 
that allow for early pruning. ■' 

Dependency-Directed Backtracking 

In the "generate and test" approach, when a line of 
reasoning fails and must be retracted, one approach is to 
backtrack to the most recent choice point (chronological 
backtracking). However, it is often much more , efficient to 
trace errors and inconsistencies back to the inferential 
steps that created them, using dependency records as is done 
in MOLGEN. Backtracking that is based on dependencies and 
determines what to invalidate is called dependency-directed 
(or relevant) backtracking. 

Multiple Lines of Reasoning 

This approach can be used to broaden the coverage of an 
incomplete search. In this case, search programs that have 
fallible evaluators can decrease the chances of discarding a 
good solution from weak evidence by carrying a limited 
number of solutions in parallel, until which of the 
solutions is best is clarified. 
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F. 


M ethods for Handling a Large Search Space by Transfor m ing 
the Space 

1 . Breaking the Problem Down Into Subproblems 

a . Non-Interacting Subproblem^ 

This approach (yielding smaller search spaces) is 

applicable for problems in which a number of non-interacting 
tasks have to be done to achieve a goal. Unfortunately, few 
real world problems of any magnitude fall into this class. 

b. Interacting Subproblems. - 

For most complex problems that can be broken up into 

subproblems, it has been found.; that the subproblems' interact 

so that valid solutions cannot be found independently. 

However, to thke advantage of the smaller search spaces 

% 

associated with this approach, a number of techniques have 
been devised to deal with these interactions. 

(1) F^nd a F_ix£d S^^uence' o_f Sub££ob^em£ So Thajt No 
Interactions Occur 

Sometimes it is possible to find an ordered 
partioning so that no interactions occur. The Rl 
system (see Table 1-3) for configuring VAX computers 
successfully takes this approach. 

(2) Least Commitment 

This technique coordinates decision-making with 
the availability of information and moves the focus of 
problem-solving activity among the available 
subproblems. Decisions are not made arbitrarily or 
prematurely, but are postponed until there is enough 
information. In planning problems this is exemplified 
by methods that assign a partial ordering of operators 
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in each subproblem and only complete the ordering when 
sufficient information on the interactions of the sub- 
problems is developed. 

(3) Constraint Proprogation 

Another approach (used by MOLGEN) is to represent 
the interaction between the subproblems as constraints. 
Constraints can be viewed as partial descriptions of 
entities, or as relationships (subgoals) that must be 
satisfied. Constraint proprogation is a mechanism for 
■■ moving inf or mation between, subproblems, . ..By introfiucing 

.. ...... V 

constraints instead of choosing particuiar values', 'a . 
problem solver is able to pursue a least commitment 
style of problem solving. 

( 4 ) Guessing or Plausible Reasoning 

Guessing is an inherent part of heuristic search, 
but is particularly important in woricing with 
interacting subproblems. For instance, in the least 
commitment approach the solution process must come to a 
halt when it has insufficient information for deciding 
between competing choices. In 'such cases, heuristic 
guessing is needed to carry the solution process along. 
If the guesses are wrong, then dependency-directed 
backtacking can be used to efficiently recover from 
them. EL and MOLGEN take this approach. 

Hierarchical Refinement into Increasingly Elaborate Spaces 

— Top Down Refinement 

the most important aspects of a problem can be 

- - - ' - .-23 
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abstracted and a high level solution developed. This 
solution can then be iteratively refined/ successively 
including more details. An example is to initially plan a 
trip using a reduced scale map to locate the main highways, 
and then use more detailed maps to refine the plan. This 
technique has many applications as the top level search 
space is suitably small. The resulting high level solution 
constrains the search to a small portion pf the search space 
at the next lower level, so that at each level the solution 
can readily be found.. This procedure is an important 
.technique f.o r . p.r e v e n t i ng combinatorial explosions in 
searching for a solution. 

Hierarchical Resolution into Contributing Sub-Spaces 
Certain problems can have their solution space hierarchical- 
ly resolved into contributing subspaces in which the 
elements of the higher level spaces are composed of elements 
from the lower spaces. Thus, in speech understanding, words 
would be composed of syllables, phrases of words, and 
sentences of phrases. The 'resulting heterogenous subspaces 
are fundamentally different from the top level solution 
space. However the solution candidates at each level are 
useful for restricting theirange of search at the adjacent 
levels, again acting as an important restraint on 
combinatorial explosion. -Another example of a possible 
hierarchical resolution is in electrical equipment design 
where subcomponents contribute to the black box level, which 
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In turn contribute to the system level. Similarly^ examples 
can be found in architecture, and In spacecraft and aircraft 
design. 
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^ ® for Handling a Large Search S£a c e by Developing 
Alternative or Additional Spaces 

1. Employing Multiple Models 

Sometimes the search for a solution utilizing a single 
model is very difficult. The use of alternative models for 
either the whole or part of the problem may greatly simplify 
the search. The SYM program is a good example of combining 
the strengths of multiple models by employing equivalent 
forms of electrical, circuits.. ...... 

2. Meta Reasoning 

It is possible to ad'd = additional layer s of spaces to a 
search space to help decide what to do next. These can be 
thought of as strategy and tactical layers in which meta 
problem solvers choose among several potential methods for 
deciding what to do’next at the problem level. The 
strategy, focusing and scheduling meta rules used in 
CRYSALIS and the use of a strategy space in MOLGEN fall into 
this category. 

H. Dealing with Time 

Little has been done in the way of expert -systems that deal 
with time explicitly. The followi.ng are app'roaches to dealing 
with time in terms of time intervals. 

I . S i tuat ional Calculus 

Situational calculus was an early approach by McCarthy 
and Hayes (1969) for representing sequences of actions and 
their effects. It uses the concept of "situations" which 
change when sufficient actions have taken place, or when 
new data indicates a situational shift is appropriate. Sit- 
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uations determine the context £or actions and» through the 
use o£ "frames,"* can indicate what changes and what remains 
the same when an action takes place. VM uses the situation 
approach for monitoring patient breathing. 

2. Planning wi th Time Constraints 

NOAH was an early parallel planner which dealt with 
interacting subgoals. The method of least commitment and 
backward chaining initially produced a partial ordering of 
operators for each plan. When interference between siibgoal 
plans was observed, the planner adjusted the ordering of the 
operators to re-so-lve the .interference to.prp.d^ce, a..fina,l 
parallel plan with time ordered operators. DEVISER (Vere, 
1981) is a recent derivative of NOAH which extends this 
parallel planning approach to treat goals with time 
constraints and durations. The principal output of DEVISER 
is a partially ordered network of parallel activities for 
use in planning a spacecraft 's actions during a planetary 
flyby. 


*A frame is a data structure for describing a stereotyped 
situation. 
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VIII. Existing Expert Systems 


Table 3 is a list# classified by function and domain of use, 
of most of the existing major expert systems. It will be observ- 
ed that there is a predomihance of systems in the Medical and 
Chemistry domains following from the pioneering efforts at 
Stanford University. From the list, it is also apparent that 
Stanford Ohiv^fxrtY~^omTnates in number of systems, followed by 
CMU, MIT and SRI, with a dozen scattered efforts elsewhere. 

The list indicates that thus far the major areas of expert 
systems development have been in d.iagnosis, data analysis and 
interpretation, planhing and design. However, the list also 
indicates that a few pioneering expert systems already exist in 
quite a number of other functional areas. In addition, a 
substantial effort is underway to build expert systems as tools 
for constructing expert systems. 

DENDRAL (Lindsay et al., 1980), which produces molecular 
structural representations from mass spectrogram data, has been 
the most widely used expert system; It has subsequently been 
generalized to CONGEN to produce a set of structural candidates 
from whatever constraining data is available. 

Feigenbaum (1982, p. 16} states that the most knowledge 
intensive system is INTERNIST, a medical diagnosis system which 
considers almost 500 diseases and contains over 100,000 pieces of 
knowledge. 
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Existing Expert Systems by Function 
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References to these systems can be found in Duda (l 98 l)> Stefik, et al. (1982) and 
Buchanan (198I) 



IX. Tools for Building Expert Systems 

To aid in the building of expert systems, special 
programming tools have recently begun to be developed. These are 
listed in Table 4. The most ambitious is AGE (Attempt to 
Generalize). AGE (Nii and Aiello, 1979) has isolated a number of 
inference, control and representation techniques from a few 
previous expert systems and has reprogrammed them for domain 
independence. AGE, itself an expert system, also guides people 
in the use of these modules in constructing their own 
individualized expert systems. AGE also provides two predefined 
conf igurations of- ■ component s. ‘ One -called the "-Blackboard’ 
framework” is for building programs that are based on the 
Blackboard model, as was used in HEARSAY II. The Blackboard 
model uses the concepts of a globally accessible data structure, 
called a blackboard, and independent sources of knowledge which 
cooperate in forming hypotheses. The other predefined 
configuration, called the "Backchain framework," is for building 
programs that use backward chaining production rules like those 
used in MYCIN. 
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Table 4 


Tool 
OPS 5 

EMYCIN 

KAS 


ROSIE 


AGE 

HEARSAY 


UNITS 


Programming Tools for Building Expert Systems 
Organization Nature 

CMU A programming language 

builton top of LISP 
designed to facilitate 
the use of production 
rules . 


Standford U. 


BRI- 


RAND 


Stanford U. 


Ill OSC/Inf ormation 
Sciences 
Institute 


Stanford U. 


A domain independent 
version of HYCIN, which 
accompanies the backward 
chaining and explanation 
approach with user aids. 

Supervises interaction 
with- - an" expert ‘ih 
building or augmenting an 
expert system knowledge 
base in a network form 
implemented for PROSPEC- 
TOR. 

A general rule-based pro- 
gramming language that 
can be used to develop 
large knowledge bases. 
Translates near-English 
into INTERLISP. 

A sophisticated expert 
system to aid users in 
building expert systems. 

A generalized domain- 
independent extension of 
HEARSAY II. Includes a 
"context" mechanism, and 
an elaborated "black- 
board" and scheduler. 

A knowledge represent- 
ation language and inter- 
active knowledge acqui- 
sition system. The 
language provides both 
for "frame" structures 
and production rules. 
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Table 4 (continued) 


Programming Tools for Building Expert Systems 


Tool Organization 

TEIRESIAS Stanford U. 


Nature 

A expert system that 
facilitates the inter- 
active transfer of 
Icnowledg^e from a human 
expert to the system via 
a (restricted) natural 
language dialog. 



X. 


Constructing An Expert System 


Duda ( 1981 , p. 262 ) states that to construct a successful 
expert system, the following prerequisites must be met: 

* there must be at least one human expert acknowledged to 
perform the task well 

* the primary source of the expert's exceptional 
performance must be special knowledge, Judgment, and 
experience 

* the expert must be able to explain the special 
knowledge, and experience and the .m,ethpd.a. .used . to. apply, 
them to particular problems 

* the task must have a well-bounded domain of application 
Randy. Davis. (MIT) at IJC.AI-81* noted that a good expert 

system application: 

* doesn't require common sense 

* takes an expert a few minutes to a few hours 

* has an expert available and willing to be committed. 
Hayes-Roth (1981, p. 2) adds that "...the problem should be 

nontrivial but tractable, with promising avenues for incremental 
expansion." 

Having found an appropriate problem and an accessible 
expert, it is then necessary to have available an appropriate 
system-building tool, such as those described in the last 
chapter. Realistic and incremental objectives should then be 
set. Major pitfalls to be avoided in developing an expert system 
are choosing a poor problem, excessive aspirations, and 
inadequate resources. 


•The International Joint Conference on Artificial Intelligence, 
Vancouver, August 1981. 
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The time for construction of early expert systems was in the 
range of 20-50 man-years. Recentlyr breadboard versions of 
simple expert sysems have been reported to have been built in as 
little as 3 man-months, but a complex system is still apt to take 
as long as 10 man-years to complete. Using present techniques, 
the time for development appears to be converging towards 5 man- 
years per system. Most systems take 2-5 people to construct, but 
not more. (It takes one to two years to develop an engineer or 
computer scientist into a knowledge engineer.) 

Randy Davis (at IJCAI-81) Indicated that the stages of 
development of • an expert system .can be considered to- be*: 

1. System design 

2. System development (conference paper level) 

3. Formal evaluation of performance 

4. Formal evaluation of acceptance 

5. Extended use in prototype environment 

6. Development of maintenance plans 

7. System release. 


*Thus far, no current system has completed all these 


stages . 
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XI. Knowledge Acquisition and Learning 

A. Knowledge Acquisition 

The key bottleneck in developing an expert system is 
building the knowledge base by having a knowledge engineer 
interact with the expert(s). Expert systems can be used to 
facilitate the process. Some of these expert systems are 
indicated in Table 3i with the KAS system being elaborated upon 
in Table 1-7. 

The most" ambitious of these systems is TEIRESIAS (Davis and 
Lenat, 1982) which supervises interaction with an expert in 
building or augmenting a MYCIN rule set. TEIRESIAS . uses a model 
of MYCIN's knowledge base to tell whether some new piece of 
information "fits in" to what is already known, and uses this 
information to make suggestions to the expert. An appropriate 
expert may not always be continuously available during the 
construction of the expert system, and in many cases may not have 
all the expertise desired. In these cases other approaches to 
acquiring the needed, expertise is desirable. 

B. Self-learning and Discovery 

Michie (1980, p. 11) observes that "The rule-based structure 
of expert systems facilitates acquisition by the system of new 
rules and modification of existing rules, not only by tutorial 
interaction with a human domain specialist but also by autonomous 
'learning'." A typical functional application is 
"classification," for which rules are discovered by induction for 
large collections of samples (Quinlin, 1979). Michie (1980, p. 
12) provides a list of examples of various "learning" expert 
systems. 
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DENDRAL, foc obtaining structural representations of organic 
molecules, is the most widely used expert system. As the 
knowledge acquisition bottleneck is a critical problem, a META- 
DENDRAL expert system (outlined in Table 1-8) was written to 
attempt to model the processes of theory formation to generate a 
set of general fragmentation rules of the form used by DENDRAL. 
The method us edi-by-»&TA— fy^timR-AL^i s to generate, test and refine a 
set of candidate rules from data of known molecule structure- 
spectrum pairs. For META-DENDRAi. and several of the other 
learning expert systems, the generated rules were found to be of 
high quality (Feigenbaum>, L98 0-.. and Michie, 1980),. 

Another attempt at modeling self-learning and discovery is 
the AM Program (Davis and Lenat, 1982) for discovery of 
mathematical concepts, beginning with elementary ideas in set 
theory. AM (outlined in Table 1-2) also uses a "generate and 
test" control structure. The program searches a space of 
possible conjectures that can be generated from the elementary 
ideas in set theory, chooses the most interesting, and pursues 
that line of reasoning. The program was successful in 
rediscovering many of the fundamental notions of mathematics, but 
eventually began exploring a bigger search space than the 
original heuristic knowledge given to it could cope with. A more 
recent project - EURISKO - is exploring how a program can devise 
new heuristics to associate with new concepts as it discovers 
them. 
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XII. Who l3 Doing It 


The following is a list by category of the "principal 
players" in expert systems. In each category, the listing 
roughly reflects the amount of effort in expert systems at that 
institution. Stanford University is the major center of effort 
in expert systems. 

Universities 

Stanford 

MIT .... 

CMU 

and scattered efforts at perhaps a dozen other universities. 

Non-Profit • 

SRI 

RAND 

JPL 

Government 

NRL AI Lab, Washington, D.C. 

NOSC, San Diego, CA 

Industrial 

Fairchild 

Schlumberger 

Machine Intelligence Corp., Sunnyvale, CA 

Xerox PARC 

Texas Instruments 

Teknowlege, Palo Alto, CA 

DEC 

Bell Labs 

IntelliGenetics, Palo Alto, CA 

TRW 

BBN 

IBM 

Hewlett Packard, Palo Alto, CA 
Martin Marietta, Denver, CO 
Hughes 
AMOCO 

JAYCOR, Alexandria, VA 
AIDS, Mt. View, CA 

Systems Control, Inc., Palo Alto, CA 
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XIII. Who is Funding It 

To date, the government has been the principal source of 
funds of work in expert systems. The funding sources in the 
government for expert systems, roughly in decreasing order of 

V 

expenditure, are: 

DARPA 

NIH (National Insitutes of Health) 

NSF 

ONR 

NLM (National Library of Medicine) 

..AFOSR . • - ■ '• 

USGS 
NASA 

DARPA and NIH have been the prim'ary funders of expert systems to 
date . 

Obtaining precise figures for funding of expert systems (ES) 
is virtually impossible because ES is not carried as a separate 
funding category. In addition, expert systems are often embedded 
in other AI systems such as image understanding systems. 
Further, with artificial intelligence becoming heavily knowledge- 
oriented, a substantial portion of current AI systems and 
activities can be viewed as having expert system components. 

Nevertheless, a rough estimate of the current total U.S. 
government yearly funding for expert systems research and 
development would be in the order of 10 million dollars. Of this 
expenditure, approximately several million is spent by DARPA to 
support basic research. 

NIH funds the AIM (Artificial Intelligence in Medicine) 
network (NIH, 1980) and its users at a little over three million 
dollars a year. This nationally shared computing resource is 
devoted entirely to designing AI applications for the biomedical 
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sciences. The community of projects using this resource is 
expert systems oriented. Approximately one third of the three 
million dollar expenditure in the AIM area can be considered to 
be for direct research, the balance being for applications, 
experimentation and system support. 

MSF, focussed more on basic research, funds approximately 
one million dollars per year in the expert systems area. Other 
government agencies probably spend another two to three million 
dollars per year to support a variety of potential applications. 

Finally, government contractors . usiag . IRAD (Independent 
Research ■ and - Development) funds (associated with their prime 
contracts) probably spend another one to two million dollars a 
year in this area. 
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XIV. Summary of the State-of-the-Ar t 

Buchanan (1981, pp. €-7) indicates that the current state of 
the art in expert systems is characterized by: 

* Narrow domain of expertise 

Because of the difficulty in building and maintaining a 
large knowledge base, the typical domain of expertise is 
narrow. The principle exception is INTERNIST, for which the 
knowledge base covers 500 disease diagnoses. However, this 
broad coverage 'is achieved by usi ng" a relatively ' shallow set 
of relationships between diseases and associated symptoms. 
V , (IJITERHIST is now , being., .replace .by. QADUCEUS , , .wh.ich can 
diagnose simultaneous unrelated diseases). 

* Limited knowledge representation languages for facts and 
relations 

* Relatively inflexible and styli zed input-output languages 

* Stylized and limited explanations by the systems 

* Laborious construction 

At present, it requires a knowledge engineer to work 
with a human expert to laboriously extract and structure the 
information to build the knowledge base. However, once the 
basic system has been built, in a few cases it has been 
possible to write knowledge acquisition systems to help 
extend the knowledge base by direct interaction with a human 
expert, without the aid of a knowledge engineer. 

* expert as a " knowledge czar . " 

We are currently limited in our ability to maintain 
consistency among overlapping items in the knowledge base. 
ThereforSf though it is desirable for several experts to 
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contribute, one expert must maintain control to insure the 
quality o£ the data base. 

In addition, most systems exhibit fragile behavior at the 
boundaries of their capabilities, so that occasionally even some 
of the best systems come up with wrong answers. Another 
limitation is that for most current systems only their builders 
or other knowledge engineers can successfully operate them. 

^ , Nevertheless r~ Randy. Davis (at IJCAI-81)- observed that’"there 
have been notable successes. A methodology has been developed 
'iEor' explicating informal' knowledge. ' Representing and using 
empirical associations, four systems have been routinely solving 
difficult problems > DENDRAL, MACSYMA, MOLGEN and PUFF - and are 
in regular use. The first three all have serious users who are 
only loosely coupled to the system designers. DENDRAL, which 
analyzes chemical instrument data to determine the underlying 
molecular structure, has been the most widely used program (see 
Lindsay et al., 1980). Rl, which is used to configure VAX 
computer systems, has been reported to be saving DEC several 
millions of dollars per year, and is now being followed up with 
XCON. 

In addition, as indicated in Table 3, several dozen systems 
have been built and are being experimented with. 
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XV 


Current Problems and Issues 


Buchanan (1981, p. 11) states, "Because o£ the increased 
emphasis on large knowledge bases, the three issues of 
explanation, acquisition and validation are becoming critical 
issues for expert systems." 

Explanation 

Explanation is needed because users cannot be expected to 
know or understand the whole program. 

Knowledge 'Acquisition 

Feigenbaum (1982, p. 13) states, "...knowledge acquisition 
is., the. criticial bottleneck problem in Artificial Intelligence." 
Knowledge acquisition is difficult and time consuming. The most 
difficult part is helping' the expert to initially structure the 
domain. The knowledge engineer takes an active role in the 
knowledge acquisition process -> interpreting and integrating the 
experts answers to questions, drawing analogies, posing counter-* 
examples, and raising conceptual difficulties. 

Duda (1981, p. 264) observes, "Past efforts to speed 
knowledge acquisition have been along three lines: (1) to develop 
smart editors that assist in entering and modifying rules, (2) to 
develop an intelligent interface that can interview the expert 
and formulate the rules, and (3) to develop a learning system 
that can induce rules from examples, or by reading textbooks and 
papers." Duda also notes "...that it is difficult for experts to 
describe exactly how they do what they do, especially with 
respect to their use of judgment, experience, and intuition... 
We need to develop more expressive languages that allow the 
expert to articulate more of the nuances and details of thought 
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processes.” Diverse sources of knowledge are also often 
required, but there is currently no good way to integrate these 
sources in reaching, a solution. 

A few k no w ledge- acqu i s i t ion systems do exist, such as 
TEIRESIAS, that are interactive and semi-automatically steer the 
expert to the needed piece of knowledge to introduce into the 
expert system under, development. However, these existing 
knowledge acquisition systems- have ' only been used to expand and 
improve a knowledge base after a vocabulary and knowledge repre- 
sentation had already been chosen and upon which the basic 
knowledge base had already been built. The knowledge-acquisition 
problem remains extremely difficult and a major impediment. 
Validation 

All complex computer programs tend to have errors and are 
therefore difficult to certify. At the moment, empirical studies 
(such as has been used to validate NYCIN as a superior 
diagnostician and therapist) may be the best we can hope for. 
However, the credibility of the system can be increased if the 
system is made intelligible and understandable, so that the user 
can be made responsible for the system and be able to modify it 
to his or her own satisfaction. More fundamentally, a 
methodology of validation needs to be developed. 

Other problems are: 

Lack of Adequate and Appropriate Hardware 

Feigenbaum (1980, p. 10) stated that "...applied AI is 
machine limited.” This is still true, though special LISP 
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machines and more general large, fast computing machines are 
beginning to become available. 

Inadequate Special Knowledge Engineering Tools 

Though software packages such as EMYCIN and OPS-5 are 
beginning to become available, there is much room for improvement 
and extension to capture more of the existing expert systems 
approaches and architectures and make them readily available to 
the new expert systems builders. Further, the concepts and 
techniques thus far developed need to be systematically drawn 
together and synthesized into higher-order patterns, so that a 
firm base' for future systejilLS can, be built, and reinventing the 
prov^erbial wheel can be avoided. 

Orderly Development and Transfer 

To capture the interest of domain experts and develop a 
major expert system requires continuous funding over several 
years, which has not always been available. Further, there is as 
yet no orderly system in the research funding agencies for 
effectively taking a successful research project and moving it 
on to appropriate applications. 

Shortage of Knowledge Engineers 

The field is relatively new and few knowledge engineers are 
currently being trained by the universities. Because of the huge 
number of potential applications, shortages of knowledge 
engineers currently exist and probably will continue to exist 
for some time. 
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XVI Research Required 


Buchanan (1981, pp. .8-14) indicates that research is re- 
quired to develop: 

* Improved knowledge acquisition systems 

* Learning by example 

* Better explanation systems and friendlier user Interfaces 

’ More adequate knowledge engineering tools 

* Better expert system architectures and inference 
procedures 

* More efficient and workable . techniques for .yrorking with, 
multiple experts and. knowledge sources 

V More adequate methods for dealing with time 

* The ability to make appropriate assumptions and 
expectations about the world 

*' The ability to exploit causal physical and biological 
models and couple them with other knowledge 
' General methods for planning 

* Analogical reasoning 

* Methods for coupling formal deduction into expert systems 

* Parallel processing approaches 

* Better knowledge representation methods 
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XVII Future Trends 


Figure 2 lists some of the expert system applications 
currently under development. It will be observed that there 
appear to be few domain or functional limitations in the 
ultimate use of expert systems. 

Figure 3 (based largely on Hayes-Roth IJCAI-81 Expert System 
tutorial and on Feigenbaum, 1982) indicates some of the future 
opportunities for expert systems. Again no obvious limitation is 

It thus appears that expert systems will eventually find use 
in most endeavor's which require symbolic reasoning with detailed 
professional knowledge - indeed most of the world's work. In the 
process, there will be exposure and refinement of the previously 
private knowledge in the various fields of application. 
Feigenbaum (1980, p. 10} states that, "The gain to human 
knowledge by making explicit the heuristic rules of a discipline 
will perhaps be the most important contribution of the knowledge- 
based systems approach." 

On a more near-term scale, in the next few years we can 
expect to see expect systems with thousands of rules. In 
addition to the increasing number of rule-based systems we can 
also expect to see an increasing number of non-rule based systems 
as not all problems are homogeneous enough to be readily cast in 
the production system framework. We can also expect much 
improved explanation systems that can explain why an expert 
system did what it did and what things are of importance. 

By the late 80's, we can expect to see intelligent, friendly 
and robust human interfaces. Much better system building tools 
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Figure 2 

Expert System Applications Now Under Development 

Medical diagnosis and prescription 
Medical knowledge automation 
Chemical data Interpretation 
Chemical and biological synthesis 
Mineral- and oil exploration 
Planning/ scheduling 
' signal Interpretation 
* Military threat assessment 
Tactical targeting 
Space defence 
Air traffic control 
Circuit diagnosis 
VLSI design 

Equipment fault diagnosis 

Computer configuration selection 
Speech understanding 
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Figure 3 

Future Opportunities for Expert Systems 


Building and Construction 

Design, planning, scheduling, control 
Equipment 

Design, monitoring, control, diagnosis, maintenance 
repair. Instruction. 

Command and Control 

.. Intelligence analysis, planning, targeting, coimmnlcatlon . 

Weapon Systems ' 

Target identification, adaptive control, electronic 
warfare 

Professions 


(Medicine, law, accounting, management, real estate, 
financial, engineering) 

Consulting, instruction, analysis 

Education 


Instruction, testing, diagnosis, concept formation 
and new knowledge development from experience. 

Imagery 

Photo interpretation, mapping, geographic problem-solving. 
Software 


Instruction, specification, design, production, verification, 
maintenance 
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Figure 3 (continued) 


Home Entertainment and Advice-giving 

Intelligent games, investment and finances, 
purchasing, shopping, intelligent information 
retrieval 

Intelligent Agents 

To assist in the use of computer-based systems 
Office Automation 
Intelligent systems 
Process Control 

Factory and plant automation 
Exploration 

Space, prospecting, etc. 
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should also be available. By 1990, we can anticipate knowledge 
acquisition systems which, after being given a basic domain 
context, can rapidly guide a human expert in forming the needed 
expert system knowledge base. Somewhere around the year 2000, 
we can also expect to see the beginnings of systems which semi- 
autonomously develop knowledge bases from text. The result of 
these developments may very well herald a maturing information 
society where expert systems put experts at everyone's disposal. 
In the process, production and information costs should greatly 
diminish, opening up major new opportunities for societal better- 
ment. • ■ ' . ‘ ... .... , .. 
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SYSTEM: CRYSALIS TABLE 1-17 

INSTITUTION . St a nford .University Characteristics of Example Expert Systems 

AUTHORS: Enelemore & Terry . 

FUNCTION: Data Interpretation 
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KS rules to Increment the hypothesis 
and add to Che event list. 

Repeatedly cycle on 2 and 3 until 
no further matches occur, then return 
control to strategy-rule Interpreter. 
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